Tracking Mse Efficiencies in Ridge Regression

نویسندگان

  • D. R. JENSEN
  • D. E. RAMIREZ
چکیده

Ridge regression is often favored in the analysis of ill-conditioned systems. A canonical form identifies regions in the parameter space where Ordinary Least Squares (OLS) is problematic. The objectives are two-fold: To reexamine the view that ill-conditioning necessarily degrades essentials of OLS; and to reassess ranges of the ridge parameter k where ridge is efficient in mean squared error (MSE) relative to OLS; and conversely. In particular, ridge is intended to ameliorate effects of ill-conditioning over a wide range of k. Contrary to conventional wisdom, ridge often must be abandoned in favor of OLS for k sufficiently large.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Modified ridge regression parameters: A comparative Monte Carlo study

In multiple regression analysis, the independent variables should be uncorrelated within each other. If they are highly intercorrelated, this serious problem is called multicollinearity. There are several methods to get rid of this problem and one of the most famous one is the ridge regression. In this paper, we will propose some modified ridge parameters. We will compare our estimators with so...

متن کامل

Weighted Ridge MM-Estimator in Robust Ridge Regression with Multicollinearity

This study is about the development of a robust ridge regression estimator. It is based on weighted ridge MM-estimator (WRMM) and is believed to have potentials in remedying the problems of multicollinearity. The proposed method has been compared with several existing estimators, namely ordinary least squares (OLS), robust regression based on MM estimator, ridge regression (RIDGE), weighted rid...

متن کامل

The Relative Efficiency Based on the MSE in Generalized Ridge Estimate

Abstract—A relative efficiency is defined as Ridge Estimate in the general linear model. The relative efficiency is based on the Mean square error. In this paper, we put forward a parameter of Ridge Estimate and discussions are made on the relative efficiency between the ridge estimation and the General Ridge Estimate. Eventually, this paper proves that the estimation is better than the general...

متن کامل

Asymptotic properties of Lasso+mLS and Lasso+Ridge in sparse high-dimensional linear regression

Abstract: We study the asymptotic properties of Lasso+mLS and Lasso+ Ridge under the sparse high-dimensional linear regression model: Lasso selecting predictors and then modified Least Squares (mLS) or Ridge estimating their coefficients. First, we propose a valid inference procedure for parameter estimation based on parametric residual bootstrap after Lasso+ mLS and Lasso+Ridge. Second, we der...

متن کامل

Performance of Some Ridge Parameters for Probit Regression: With Application to Swedish Job Search Data

In ridge regression the estimation of the ridge parameter is an important issue. This paper generalizes some methods for estimating the ridge parameter for probit ridge regression (PRR) model based on the work of Kibria et al. (2011). The performance of these new estimators are judged by calculating the mean square error (MSE) using Monte Carlo simulations. In the design of the experiment we ch...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009